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REGULATING USAGE OF COMPUTER RESOURCES 



CROSS-REFERENCE TO RELATED APPLICATIONS 

This application claims the priority of United States Provisional Patent Application 
No. 60/097,912, filed August 26, 1998. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to networks, and more particularly, to a 
method for regulating the usage of resources in such networks. 

Networks, such as local area networks (LANs), are used for interconnecting many 
different devices, such as computers and peripherals, to allow users to communicate with one 
another. Further, these networks are used to allow users to share access to the connected 
peripherals. The LAN may be a heterogeneous LAN in which many different 
communication protocols are carried on a single Ethernet or token-ring medium. Examples 
of different protocols are IPX, which is typically used by DOS-based PCs and UDP/IP, 
which is typically used by UNIX-based work stations. Each type of device may be adapted 
through software to communicate using multiple different protocols. 

A peripheral also can include software. The software is in the form of multiple 

protocol stack modules that allow the peripheral to communicate using multiple protocols in 

order to be shared on a heterogeneous LAN. A protocol stack is a software module that 

processes packets of data which are received from or transmitted to the LAN using the 

corresponding protocol. The protocol stacks in the associated lower-level software for 
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network communications are typically stored and executed on a network interface device that 
may be embedded in or attached to the peripheral. The network interface device serves as an 
interface which allows the peripheral to communicate with other network devices via the 



Due to the large number of users and devices associated with the LAN, various 
potentially unrelated devices (e.g., spawned by separate applications) compete for finite 
system resources, such as memory allocation space, disk access, and processor time. A 
device typically requests usage of a resource from the system's operating system. If the 
resource is not being used, the operating system grants access. In some networking 
environments, the device is allowed to use and hold the resource indefinitely. This can block 
other processes access to the same resource. This results in delays in or a potential 
catastrophic failure of the system. This may occur, for example, when one device is more 
important and/or urgent than another. For example, the industrial process control of a 
nuclear reactor may be more important than down loading information from the Internet. 

Many techniques have been developed to regulate computer resource usage in a 
network system. For example, a maximum time limit for the usage of a given resource may 
be used. One drawback to this technique is that a specific device may require more than the 
specific maximum time limit to execute a specific resource. 

Another known technique is to fix a process time that is substantially the same for 
each resource. Again, this technique has certain drawbacks that include not allowing a 
process to execute a resource for an extended period of time to perform an important 
function. 



LAN. 
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SUMMARY OF THE INVENTION 



In general, in one aspect, the invention is directed to a method of managing usage in a 
network system that includes indicating available credit for usage of a resource, and 
regulating usage of the resource by a process based on the indicated available credit. 

Implementations of the invention include one or more of the following. The resource 
may be a memory space or system processor time. The network may be an embedded 
computer system, or may operate in a real-time networking environment. The method may 
be modeled as a leaky bucket. The available credit may be modified b y_adjustingj ^_^ 
maximum resource usage value of the resource. A message may be sent to a process waiting 
to use a resource when the available credit exceeds a specified amount. 

In another aspect, the invention is directed to a method of managing a plurality of 
resources in a network having a plurality of devices that includes creating a software tool 
corresponding to each of the plurality of resources on each of the plurality of devices 
accessing the plurality of resources . The software tool may be used to regulate the usage of 
any of the plurality of resources by any of the plurality of devices. 

Implementations of the invention include one or more of the following. A descriptor 
representative of any of the software tools may be allocated to any of the plurality of 
devices. Each software tool may be associated with a maximum usage level. The maximum 
usage level of the software tool may be decremented in response to the use of the resource 
associated with the tool by any of the devices. An available credit based on the usage of the 
resource associated with the tool may be calculated as a function of the maximum usage 
level. A device waiting to use the resource associated with the tool can be informed of the 
available credit. A message may be sent to a network address associated with the waiting 
device to indicate when the available credit exceeds a specified usage level. The maximum 
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usage level may be incremented to at least correspond to the specified usage level. The 

maximum usage level may be overridden to allow a device access to one of the resources. 

, — — - — 1 ' — — - ■ ■ — 

The software tool may be destroyed in response to a request from one of the devices. 

In yet another aspect, the invention is directed to a network including a plurality of 
devices having a plurality of resources running in the network. The network may include 
computer software residing on a computer readable medium at each device accessing the 
plurality of resources that cause the device to indicate available credit for usage of one of the 
resources, and regulates the usage of the resource by a device based on the indicated 
available credit. 

Other advantages will be come apparent from the following description including the 
drawings and the claims. 



A common problem in a network system is that certain resources, such as memory, 
are substantially consumed by devices, such as computers, connected to the network system. 
This causes other devices connected to the system to delay executing the same process. 
Thus, urgent/important processes are unable to be accessed by these devices. This is because 
the computer system has a limited number of finite resources. After a threshold of these 
resources has been reached, the entire system can fail. 



BRIEF DESCRIPTION OF THE DRAWING 



FIG. 1 is a block diagram of an exemplary network system. 
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Accordingly, the present inventor has discovered a method that can control access to 
resources in a network system in an optimal manner. The preferred method includes a 
software tool that can be programmed into a device connected to the system. In accordance 
with the preferred method, the software tool can be used to model a resource of the network. 
The software tool which will be referred to as a "leaky bucket" and may have a hole in its 
bottom. In accordance with the preferred method, this bucket may have three characteristics. 
First, water may be poured into the bucket. However, the bucket will become full if too 
much water is poured into the bucket. Second, water may flow out of the hole in the bottom 
of the bucket at a constant rate. Thus, water may be poured into the bucket at this constant 
rate. Finally, if the bucket is not full of water, additional water may be poured into the 
bucket at a rate that is higher than the rate at which water flows out of the hole. However, 
the size of the bucket sets a maximum value for the amount of water that can be added into 
the bucket. 

The network system may be an embedded system. An embedded system is a special 
purpose networking environment in which all processes cooperate to achieve a common goal. 
Certain examples of such a system include a network router, a telephone switch, and an 
industrial control system. Preferably, the software tool is accessible through a programming 
interface. Further, the software tool is an abstract object. This means that the software tool 
is not directly associated with a queue or any other object in the system. 

The preferred method for allocating computer resources in a network is a software 
tool that a programmer may explicitly set-up and use when writing code for a particular 
device connected to the network, such as a network switch, a computer, or other similar 
network device. Alternatively, the manufacturer of an embedded system could implement, as 
a standard programming practice, that all of the programmers use the preferred method for 
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accessing specific resources in a specific manner. In the preferred method, the leaky bucket 
is created for each resource. The preferred method may be programmed in a suitable 
programming language, such as C, C++, Ada, Pascal, Fortran, Java, or assembly language. 
Examples of resources that can be regulated include memory, disk access, and system 
process time. 

FIG. 1 illustrates a block diagram of an example network in which the preferred 
method may be used. The preferred method may also be used in any real-time networking 
environment. FIG. 1 illustrates a LAN 10 as an Ethernet medium that has a bus-type 
architecture. A token-ring medium having a ring-type architecture can also be used. 
Connected to the LAN 10 is a personal computer (PC) 20 which may serve as a system 
administrator's computer, a PC 30 which can serve as a print server for printers 85 and 95 
and workstations 60. The workstations 60 is any general purpose or dedicated computer 
including PCs, Apples, Unix, and other computer workstations that can run an operating 
system. For example, the operating system may be a windows-based operating system. A 
file server 70 may allow shared access to a network disk 75 and a network expansion 
board 100 can permit shared access to a printer 105. A network expansion device 120 may 
provide shared access to a printer 122. In addition, a network interface 125 can allow shared 
access to a copier 1 16 via a multiple device controller 130. 

In operation, the workstations 60 may access resources from other devices connected 
to the LAN 10. In some cases, multiple workstations 60 will attempt to access resources 
from the connected devices. However, if a number of stations 60 attempt to access the same 
resource, such as a server or another computer attached to the network, the resources in the 
server or computer may not be sufficient to accommodate all the requests from the multiple 
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workstations 60. Further, a single workstation 60 may be able to acquire all the resources in 
the server. This means that no resources will be available for the other workstations 60. 

An example of a programming interface in accordance with the preferred method is 
as follows. This example is set forth in detail in Appendix A and incorporated herein by 
reference. A simplification of the example described in Appendix A follows. The leaky 
bucket may be created by a programmer or embedded in a system by executing the following 
routine CreateLeakyBucket. In accordance with the preferred method, the 
CreateLeakyBucket function may be invoked when a work station 60 is initialized or at some 
other time while the station 60 is connected to the network. 



t_return /*RET 
CreateLeakyBucket( 

t_leaky_bucket *pBucket, /*IN 

dword c, /*IN 

dword m, /*IN 

dword t) /*IN 



Error code */ 

Address of leaky bucket descriptor */ 
Drain amount every t jas */ 
Fill Level maximum */ 
Time in fxs between drains */ 



A leaky bucket descriptor having the above form t_leaky_bucket may be allocated by 
the station 60 that invokes the CreateLeakyBucket routine. The descriptor may be stored in a 
memory of the workstation 60. 

In the preferred method, each leaky bucket has a "Fill Level". A Fill Level may be 
defined a s a curren tusage of a resource contro lled by the leaky bucket. When a programmer 
uses the bucket, a numerical value representing the desired amount of resource usage is 
added to the Fill Level. After a pre-defined period, for example, t microseconds, a value "c" 
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is subtracted from the Fill Level. The value c may be defined as an estimate of how much of 
a resource is available (i.e., not being used by another process) every t microseconds. 
Preferably, the Fill Level does not fall below zero. 

The bucket size "m" is the maximum allowed Fill Level in the bucket. The difference 
5 between the maximum Fill Level and a current Fill Level is called the "credit". 

The following functions may also be implemented for configuring the leaky bucket in 
accordance with the preferred method: 

ModifVLeakyBucket 

ModifyLeakyBucket modifies the parameters m, t, c of a leaky bucket created by 
yj calling the routine CreateLeakyBucket. Preferably, the curr ent Fill Level in the leaky bucket 

45 is not changed during this routine. The current Fill Level may also not change for a current 

^ Fill Level that is greater than the maximum Fill Level m. 

O ' 

if V s 

W\ t_return /*RET Error code */ 

ModifyLeakyBucket( 

t_leaky_bucket *pBucket, /*IN Address of leaky bucket descriptor */ 

dword c, /*IN Drain amount every t jas */ 

dword m, /*IN Fill level maximum (max. credit) */ 

20 dword t) /*IN Time in \is between drains (frequency) */ 
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CreditLeft 



CreditLeft returns the remaining credit to the station 60 using a specified leaky 
bucket. This routine permits a requesting station 60 to determine if the leaky bucket has an 
adequate Fill Level to execute the requested resource. 



UseLeakyBucket 

UseLeakyBucket increments the Fill Level on a specified leaky bucket by a specified 
amount. This route returns TRUE if the Fill Level can be incremented without the bucket 
overflowing. This means that a station 60 can access the requested resource. If the available 
credit is less than AMOUNT, the requested usage of a resource by a station 60, or if another 
station 60 is waiting to use the requested resource, the Fill Level is not incremented, and the 
function returns FALSE. This means that a requesting station 60 is generally unable to use 
the resource until some later time, when enough credit is available to handle the request from 
the station 60. 



sdword 



/*RET 



Credit left */ 



CreditLeft( 



t_leaky_bucket *pBucket; /*IN 



Address of leaky bucket descriptor */ 



• 
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bool 



/*RET 



Success */ 



UseLeakyBucket( 



t_leaky_bucket *pBucket, 



/*IN 



Address of leaky bucket descriptor */ 



dword amount, 



/*IN 



Usage amount */ 



dword maxi, 



/*IN 



Alternative maximum (or 0 for default) 



*/ 



t_leaky_bucket_request *pmsgReq); /*IN Leaky bucket request message */ 
maxi and pmsqReq 

If a station 60 using the leaky bucket discovers that the requested usage of resources 
is not available, the station can attempt to use the resource at some later time. Alternatively, 
it can use a different resource. The station may also request the leaky bucket mechanism to 
inform it when the resources are available. In this case, the operating system of the network 
can be instructed to call the routine pmsgReq. This causes a message to be sent to the 
requesting station 60 when the requested usage is available. 

For example, the argument pmsqReq of t_leaky_bucket_request*pmsgReq may be 
NULL to indicate no message should be sent or the network address of a station 60. For a 
specified network address, the notification message will be sent to the station 60 when the 
desired credit is available. Before this message is sent, the Fill Level is preferably 
incremented by at least the amount needed to satisfy the amount of the requested usage. 

The parameter maxi may be assigned to a numerical value to specify a maximum Fill 
Level to be used greater than the value m specified when the leaky bucket was initially 
created. This can be used when a station 60 requests usage of a resource that would exceed 
the limits c, t, m of the system. For example, if the resource is important or has a high 
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priority level, maxi may be set to a high numerical value to override the initial maximum Fill 
Level m. This allows an important or critical process, such as in a nuclear reactor system, to 
access a resource for a greater period of time to execute the process. If the process is not 
important, the value of m is set to logical zero (0). Accordingly, using maxi can vary the 
credit available for requested resource. 

DestroyLeakyBucket 

DestroyLeakyBucket prevents a timer t from further decrementing the Fill Level. 
After this function has been called, there will be no external references to the leaky bucket, 
and the memory previously occupied by the leaky bucket descriptor t_leaky_bucket initiated 
by calling CreateLeakyBucket may be used for other purposes by the station 60. 

void 

DestoryLeakyBucket( 

t_leaky_bucket *pBucket; /*IN Address of leaky bucket descriptor */ 

The following function is an example using the above software tool in accordance 
with the preferred method. This example uses a leaky bucket with a leaky bucket descriptor 
&Bucket to allocate the usage of memory in the network system. If the memory can be 
allocated, as determined by the above UseLeakyBucket routine, the memory is allocated and 
the function returns OK to indicate that the memory can be allocated. If the leaky bucket 
does not have enough credit to satisfy the requested usage, the memory is not allocated and 
the function returns NO_CREDIT. 
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t return 



/*RET 



Error code */ 



allocate_memory( 



int size, 



/*IN 



Size of memory to allocate */ 



void **address) 



/*OUT 



Address of allocated memory */ 



{ 



if (!UseLeakyBucket (&bucket, size, 0, NULL)) 
return NOCREDIT; 

else { 

♦address = malloc(size); /* This is the actual memory allocation */ 
return OK; 

} 



The preferred method can be used in real-time environments including industrial 
process control, weapons systems, network interfaces, and the distribution of power between 
computation intensive tasks. The preferred method can also be used in a general purpose 
computing environment. 

The preferred method uses a leaky bucket mechanism to enforce voluntary restraint 
on usage of resources by competing processes. This is a power tool for designers of 
embedded systems to regulate the usage of resources in an efficient and flexible manner. 
Further, the preferred method gives programmers the flexibility to request additional usage 
time for important process request or even to disregard this limitation. Thus, resources can 
be allocated in a specified manner to favor use for more important processes. 
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The methods and mechanisms described here are not limited to any particular 
hardware or software configuration, or to any particular communications modality, but rather 
they may find applicability in any communications or computer network environment. 

The techniques described here may be implemented in hardware or software, or a 
combination of the two. Preferably, the techniques are implemented in computer programs 
executing one or more programmable computers that each includes a processor, a storage 
medium readable by the processor (including volatile and non-volatile memory and/or 
storage elements), and suitable input and output devices. The programmable computers may 
be either general-purpose computers or special-purpose, embedded systems. In either case, 
program code is applied to data entered with or received from an input device to perform the 
functions described and to generate output information. The output information is applied to 
one or more output devices. 

Each program is preferably implemented in a high level procedural or object-oriented 
programming language to communicate with a computer system. However, the programs 
can be implemented in assembly or machine language, if desired. In any case, the language 
may be a compiled or interpreted language. 

Each such computer program is preferably stored on a storage medium or device 
(e.g., CD-ROM, hard disk, magnetic diskette, or memory chip) that is readable by a general 
or special purpose programmable computer for configuring and operating the computer when 
the storage medium or device is read by the computer to perform the procedures described. 
The system also may be implemented as a computer-readable storage medium, configured 
with a computer program, where the storage medium so configured causes a computer to 
operate in a specific and predefined manner. 
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A number of embodiments of the present invention have been described. 

Nevertheless, it will be understood that various modifications may be made without 

departing from the spirit and scope of the invention. Accordingly, other embodiments are 

within the scope of the following claims. 

5 
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